THE MATRICIAL RELAXATION OF A 
LINEAR MATRIX INEQUALITY 



J. WILLIAM HELTON\ IGOR KLEP^ AND SCOTT MCCULLOUGH^ 

Abstract. Given linear matrix inequalities (LMIs) Li and L2 it is natural to ask: 

(Qi) when does one dominate the other, that is, does Li{X) y imply L2{X) y 0? 

(Q2) when are they mutually dominant, that is, when do they have the same solution set? 

The matrix cube problem of Ben-Tal and Nemirovski [B-TN02] is an example of LMI 
domination. Hence such problems can be NP-hard. This paper describes a natural relaxation 
of an LMI, based on substituting matrices for the variables xj. With this relaxation, the 
domination questions (Qi) and (Q2) have elegant answers, indeed reduce to constructible 
semidefinite programs. As an example, to test the strength of this relaxation we specialize it 
to the matrix cube problem and obtain essentially the relaxation given in [B-TN02]. Thus our 
relaxation could be viewed as generalizing it. 

Assume there is an X such that Li{X) and L2{X) are both positive definite, and suppose 
the positivity domain of Li is bounded. For our "matrix variable" relaxation a positive answer 
to (Qi) is equivalent to the existence of matrices Vj such that 

(Ai) L2{x) = V{Li{x)Vi + ■■■ + V;Ll{x)V^,. 

As for (Q2) we show that Li and L2 are mutually dominant if and only if, up to certain 
redundancies described in the paper, Li and L2 are unitarily equivalent. Algebraic certificates 
for positivity, such as (Ai) for linear polynomials, are typically called Positivstellensatze. The 
paper goes on to derive a Putinar-type Positivstellensatz for polynomials with a cleaner and 
more powerful conclusion under the stronger hypothesis of positivity on an underlying bounded 
domain of the form {X \ L{X) ^ 0}. 

An observation at the core of the paper is that the relaxed LMI domination problem is 
equivalent to a classical problem. Namely, the problem of determining if a linear map r from 
a subspace of matrices to a matrix algebra is "completely positive". Complete positivity is 
one of the main techniques of modern operator theory and the theory of operator algebras. 
On one hand it provides tools for studying LMIs and on the other hand, since completely 
positive maps are not so far from representations and generally are more tractable than their 
merely positive counterparts, the theory of completely positive maps provides perspective on 
the difficulties in solving LMI domination problems. 
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1. Introduction and the statement of the main results 

In this section we state most of our main results of the paper. We begin with essential 
definitions. 

1.1. Linear pencils and LMI sets. For symmetric matrices Aq, Ai, . . . , Ag G SM'^^'^, the 
expression 

9 

(1.1) L{x) = Ao + Y^ AjXj G SM'^^^(x) 

i=i 

in noncommuting variables x, is a linear pencil. If = 1^ then L is monic. If Aq = 0, then 
L is a truly linear pencil. The truly linear part Ylj=i ^j^j ^ linear pencil L as in (1.1) 
will be denoted by L^^\ 

Given a block column matrix X = col(Xi, . . . ,Xg) G (SIR"^")^, the evaluation L{X) is 
defined as 

(1.2) L{X) = Ao(S)In + ^Aj(S) Xj G SM'^"^'^". 

The tensor product in this expressions is the usual (Kronecker) tensor product of matrices. 
We have reserved the tensor product notation for the tensor product of matrices and have 
eschewed the strong temptation of using A<^Xi in place of Ax£ when X£ is one of the variables. 

Let L be a linear pencil. Its matricial linear matrix inequality (LMI) set (also called 

a matricial positivity domain) is 

(1.3) Vl ■=[j{X e (S]R"^")f I L{X) h 0}. 
Let 

(1.4) VL{n) = {X £ (SM'^^'^)^ I L{X) ^ 0} = n (SM"^")^ 

(1.5) dVL{n) = {X e (SM'^^'^)3 | L{X) >z 0, L{X) f 0}, 

(1.6) dVL = \]dVi^{n). 

nGN 

The set 'Pl(I) ^ is the feasibility set of the semidefinite program L{X) ^ and is called a 
spectrahedron by algebraic geometers. 

We cah Vl bounded if there is an G N with \\X\\ < iV for all X G Pl. We shall see 
later below (Proposition 2.4) that Dl is bounded if and only if 'Z?i(l) is bounded. 

1.2. Main results on LMIs. Here we state our main theorems giving precise algebraic char- 
acterizations of (matricial) LMI domination. While the main theme of this article is that 
matricial LMI domination problems are more tractable than their traditional scalar counter- 
parts, the reader interested only in algorithms for the scalar setting can proceed to the following 
subsection, §1.3, and then onto Section 4. 
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Theorem 1.1 (Linear Positivstellensatz). Let Lj G SM'^^^'^J (x), j = 1,2, be monic linear 
pencils and assume Dl-^ is bounded. Then D^-^ ^T^i^ if and only if there is a & N and an 
isometry V G MM'ii><'^2 g^c/i that 

(1.7) L2{x) = V*{l^(S)L^{x))V. 
Suppose L G §R'^'"^{x), 

g 

L = I + ^Ajxj 
i=i 

is a monic linear pencil. A subspace ^ C R'^ is reducing for L \i T-L reduces each Aj] i.e., if 
AjU C T-L. Since each Aj is symmetric, it also follows that Ajl-L^ Q T-L^. Hence, with respect 
to the decomposition = 'H® T-L^, L can be written as the direct sum, 

L = L e = 

and Aj is the restriction of Aj to T-L. (The pencil L-*- is defined similarly.) If T-L has dimension 
i, then by identifying T-L with M^, the pencil L is a monic linear pencil of size £. We say that 
L is a subpencil of L. If moreover, T>i = P^, then L is a defining subpencil and if no proper 
subpencil of L is defining subpencil for Dl, then L is a minimal defining {sub)pencil. 

Theorem 1.2 (Linear Gleichstellensatz) . Let Lj G §]R'^^'^(x), j = 1,2, be monic linear pencils 
with Vl^ bounded. Then Vl-^ = V^^ '^'^d only if minimal defining pencils Li and L2 for Vi^ 
and Vi^ respectively, are unitarily equivalent. That is, there is a unitary matrix U such that 

(1.8) L2{x) = U*Li{x)U. 

An observation at the core of these results is that the relaxed LMI domination problem 
is equivalent to the problem of determining if a linear map r from a subspace of matrices to a 
matrix algebra is completely positive. 

1.3. Algorithms for LMIs. Of widespread interest is determining if 
(1-9) VL,a)CVL,{l), 

or if 25^^(1) = 25^2(1) • For example, the paper of Ben-Tal and Nemirovski [B-TN02] exhibits 
simple cases where determining this is NP-hard. We explicitly give (in Section 4.1) a certain 
semidefinite program whose feasibility is equivalent to 2?^^ ^T)l2- Of course, iiT>L^ ^ 2^L2; 
then T>L^{1) C D^^^l). Thus our algorithm is a type of relaxation of the problem (1.9). The 
algorithms in this section can be read immediately after reading Section 1.3. 

We also have an SDP algorithm (Section 4.4) easily adapted from the first to determine 
if Pi is bounded, and what its "radius" is. Proposition 2.4 shows that Dl is bounded if and 
only if Pl(1) is bounded. Thus our algorithm definitively tells if T>l{1) is a bounded set; in 
addition it yields an upper bound on the radius of 'Dl(I). 



L 





where L = L + -^j^j, 
7=1 
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In Section 4.5 we specialize our relaxation to solve a matricial relaxation of the classical 
matrix cube problem, finding the biggest matrix cube contained in P/,. It turns out, as shown 
in Section 5, that our matricial relaxation is essentially that of [B-TN02]. Thus the our LMI 
inclusion relaxation could be viewed as a generalization of theirs, indeed a highly canonical 
one, in light of the precise correspondence to classical complete positivity theory shown in 
§3. A potential advantage of our relaxation is that there are possibilities for strengthening it, 
presented generally in Section 4.2 and illustrated on the matrix cube in Section 5.2. 

Finally, given a matricial LMI set Vl, Section 4.6 gives an algorithm to compute the linear 
pencil L G SM.'^^'^{x) with smallest possible d satisfying = P^. 

1.4. Positivstellensatz. Algebraic characterizations of polynomials p which are positive on 
T>L are called Positivstellensatze and are classical for polynomials on R^. This theory underlies 
the main approach currently used for global optimization of polynomials, cf. [Las09, Par03]. 
The generally noncommutative techniques in this paper lead to a cleaner and more power- 
ful commutative Putinar-type Positivstellensatz [Put93] for p strictly positive on a bounded 
spectrahedron Pl(1). In the theorem which follows, §M'^^'^[y] is the set of symmetric d x d 
matrices with entries from M[y], the algebra of (commutative) polynomials with coefficients 
from M. Note that an element of §]R'^^'^[y] may be identified with a polynomial (in commuting 
variables) with coefficients from SM'^^'^. 

Theorem 1.3. Suppose L G SIR'^^'^[y] is a monic linear pencil and Pl(1) is bounded. Then 
for every symmetric matrix polynomial p € ]R^^^[y] with p|x)^(i) >~ 0, there are Aj G R^^^[y], 
and Bk € M'^^^fy] satisfying 



We also consider symmetric (matrices of) polynomials p in noncommuting variables with 
the property that p{X) is positive definite for all X in a bounded matricial LMI set T>l\ see 
Section 6. For such noncommutative (NC) polynomials (and for even more general algebras of 
polynomials, see Section 7) we obtain a Positivstellensatz (Theorem 6.1) analogous to (1.10). 
In the case that the polynomial p is linear, this Positivstellensatz reduces to Theorem 1.1, 
which can be regarded as a "Linear Positivstellensatz". For perspective we mention that the 
proofs of our Positivstellensatze actually rely on the linear Positivstellensatz. For experts we 
point out that the key reason LMI sets behave better is that the quadratic module associated 
to a monic linear pencil L with bounded Pl is archimedean. 

1.5. Outline. The paper is organized as follows. Section 2 collects a few basic facts about 
linear pencils and LMIs. In Section 3, inclusion and equality of matricial LMI sets are char- 
acterized and our results are then applied in the algorithmic Section 4. Section 5 gives some 
further details about matricial relaxations of the matrix cube problem. The last two sections 
give algebraic certificates for polynomials to be positive on LMI sets. 



(1.10) 




3 



k 



THE MATRICIAL RELAXATION OF AN LMI 



5 



2. Preliminaries on LMIs 
This section collects a few basic facts about linear pencils and LMIs. 

Proposition 2.1. If L is a linear pencil and T>l contains as an interior point, i.e., G 
T>L \ dT>L, then there is a monic pencil L with T>l = Dj^. 

Proof. As G Dl, L{0) = Aq is positive semidefinite. Since ^ SI'l, ^ for some small 
£ G M>o and all j. Let V = Ran Q and set 

Aj := Aj\v for j = 0,l,...,g. 

Clearly, • ^ ~^ ^ is invertible and thus positive definite. We next show that Ran Aq 
contains Ran Aj for j > 1. If x _L Ran i-e-j = 0, then = x*Aqx > it ex*AjX and hence 
x*AjX = 0. Since + ^Aj > and x*{Ao + £Aj)x = it follows that (^o + £Aj)x = 0, and 
since Aqx = 0, we finally conclude that AjX = 0, i.e., x _L Ran Aj. Consequently, Aj : V ^ V 
are all symmetric and T)l = T)j^ for L = Aq + X]j=i ^j^j- 

To build L, factor Aq = B*B with B invertible and set 

Aj := B-*AjB-^ for j = 0, . . . , g. 
The resulting pencil L = I + AjXj is monic and = Pj. ■ 

Our primary focus will be on the matricial LMI sets Dl- If the spectrahedron I'l(I) C 
does not contain interior points, then (as it is a convex set) it is contained in a proper 
affine subspace of M^. By reducing the number of variables we arrive at a new pencil whose 
spectrahedron does have an interior point. By a translation we can ensure that is an interior 
point. Then Proposition 2.1 applies and yields a monic linear pencil with the same matricial 
LMI set. This reduction enables us to concentrate only on monic linear pencils in the sequel. 

Lemma 2.2. Let L G SU.'^^'^{x) be a linear pencil with Vl hounded, and let L G ^W^^^{x) he 
another linear pencil. Set s := n{l + g) . Then: 

(1) L|x5^ y if and only ifL\x>^{s) ^ 0; 

(2) L\x>^ >z if and only if L\i,^(^g-^ >z 0. 

Proof. In both statements the direction (=^) is obvious. If -L]©^ ^ 0, there is an £, X G ^^^[tj 
and V = ®]=iVj G (M^)" with 

{L{X)v,v) < 0. 

Let 

/C := span{{XiVj \i = l,...,g, j = I, . . . ,n} U {vj \ j = 1, . . . ,n}) . 
Clearly, dim/C < s. Let P be the orthogonal projection of onto JC. Then 

{L{PXP)v,v) = {L{X)v,v) < 0. 
Since PXP G T>l{s), this proves (1). The proof of (2) is the same. ■ 
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Lemma 2.3. Let L be a linear pencil. Then 

Vl is bounded <^ + is bounded. 

Proof. Given a positive N £N, consider the monic linear pencil 



JNix) 



1 

N 



N xi 
xi N 



N 



1 

N 



N X* 
X NL, 



t,{g+l)x(g+l) 



(x). 



Note that is bounded if and only if for some G N, J'n\'Dl — 0. The statement of the 
lemma now follows from Lemma 2.2. ■ 

To the linear pencil L we can also associate its matricial ball 

Bl := U {X G (SM'^^'^)'^ I \\L[X)\\ <1] = {X\I- L{Xf h 0}. 

nGN 

Observe that Bl = T>li iov 



(2.1) 



L' 



I L 
L I 



Proposition 2.4. Let L be a linear pencil. Then: 

(1) Vl is bounded if and only ifVi{l) is bounded; 

(2) Bl is bounded if and only ifBi^l) is bounded. 

Proof. (1) The implication (=^>) is obvious. For the converse suppose T>l is unbounded. By 
Lemma 2.3, this means T>l{N) is unbounded for some G N. Then there exists a sequence 
from (S]R^^^)5 such that = 1 and a sequence tk G M>o tending to oo such that 

L{tkX'^^y) ^ 0. A subsequence of (X^^)) converges to X = {Xi,...,Xg) G (SM^^^)^' which 
also has norm 1. For any t, tX^^^ — )• tX and for k big enough, tX^''^ G T^l by convexity. So X 
satisfies L{tX) t for all t G M>o. 

There is a nonzero vector v so that {XiV,v) ^ for at least one i. Then with Z : = 
{{Xiv, v),..., {XgV, v)) eR3^ {0}, and V denoting the map F : M ^ defined by Vr = rv, 

L{tZ) = {I®VyL{tX){I®V) 

is nonnegative for all t > 0, so T)l{1) is unbounded. 

To conclude the proof observe that (2) is immediate from (1) using (2.1). ■ 

A linear pencil L is nondegenerate, if it is one-one in that L{X) = L{Y) implies X = Y 
for all n G N and X, y G (SIR"^")^. In particular, a truly linear pencil L is nondegenerate if 
and only if L{X) / for X 7^ 0. 

Lemma 2.5. For a linear pencil L{x) = Aq + X]j=i -^j^j following are equivalent: 
(i) L is nondegenerate; 
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(ii) L{Z) = L{W) implies Z = W for all Z,W e R9 ; 

(iii) the set {Aj \ j = 1, . . . , g} is linearly independent; 

(iv) L^^^ is nondegenerate. 

Proof. Clearly, (i) 4^ (iv). Also, (i) =^ (ii) and (ii) (iii) are obvious. For the remaining 
implication (iii) (i), assume L{X) = L{Y) for some X,Y € (S]R"^")3. Equivalently, L^'^\X- 
Y) = 0. Note that L'^^^X - Y) equals Ylj=ii^j - Yj) ® modulo the canonical shuffle. If 
this expression equals 0, then the linear independence of the Ai,. . . ,Ag (applied entrywise) 
implies X = Y. ■ 

Proposition 2.6. Let L = I + ^j^i^jXj G SM.^^'^{x) be a monic linear pencil and let L^^^ 
denote its truly linear part. Then: 

(1) Bi^(i) is bounded if and only if L^^^ is nondegenerate; 

(2) ifDi is bounded then {I,Aj \ j = 1, . . . , g} is linearly independent; the converse fails in 
general. 

Proof (1) Suppose L^^^ is not nondegenerate, say Yl^j=i ^j^j — some zj G R. Then 
with Z = (zi, . . . , Zg) £ we have tZ G -S^ci) for every t, so 13^{i) is not bounded. Let 
us now prove the converse. First, if is unbounded, then by Proposition 2.4, ;B^(i)(l) is 
unbounded. So suppose Bj^(i){l) is unbounded. Then there exists a sequence (ZC^)) from R9 
such that \\Z^''^\ = 1 and a sequence tk G M>o tending to oo such that ||L(^)(tfc^^''^)|| < 1. A 
subsequence of {Z^'^^) converges to Z G which also has norm 1; however, \\L^^\Z)\\ = and 
thus L^^^ is degenerate. 

For (2) assume 

(2.2) X + ^XjAj = 

j 

with A, Xj G M. We may assume xj / for at least one index j. Let Z = (xi, . . . , Xg) / 0. If 
A = 0, then L{tZ) = I is positive semidefinite for all f G M. Thus T>l is not bounded. 

Now let A G M be nonzero. Then L{Z/X) = 0. Thus, L{tZ/\) >z for all t < 0, showing 
Vl is unbounded. 

The converse of (2) fails in general. For instance, if the Aj are positive semidefinite, then 
Vl contains (M>o)^ and thus cannot be bounded. ■ 

3. Matricial LMI sets: Inclusion and Equality 

Given Li and L2 monic linear pencils 

9 

(3.1) Lj{x) = I + Y1 Aj^exe G m'^^'"^^ {x), j = 1, 2, 

we shall consider the following two inclusions for matricial LMI sets: 

(3.2) Vl.CVl,; 
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(3.3) dVL.^dVL,. 

Equation (3.2) is equivalent to: for all n G N and X G (SM"^")^, 

Li{X) =^ L2{X) h 0. 

Similarly, (3.3) can be rephrased as follows: 

Li{X)yO and Li{X) ^ L2{X) h and L2(X) ^ 0. 

In this section we characterize precisely the relationship between Li and L2 satisfying 
(3.2) and (3.3). Section 3.1 handles (3.2) and gives a Positivstellensatz for linear pencils. 
Section 3.3 shows that "minimal" pencils Li and L2 satisfying (3.3) are the same up to unitary 
equivalence. 

Example 3.1. By Lemma 2.2 it is enough to test condition (3.2) on matrices of some fixed 
(large enough) size. It is, however, not enough to test on X € M^. For instance, let 





"0 


1 


0" 




"0 





1" 




' 1 


Xl 


X2 


A{xi,X2) =/ + 


1 








Xi + 











X2 = 




1 


















1 










X2 





1 



and 



Then 



T{xi,X2) = I + 



1 




1 




-1 


Xl + 


1 


X2 = 


Va = 


-{{Xl, 


X2) 1 


1 - xf 



Thus Va{1) 



Pa(1) = {(Xi,X2) G 
Pr(l) = {(Xi,X2) G 
'Dr(l). On one hand. 



1 + Xl X2 
X2 1 - Xl 



I Xf + X^ < 1}, 

I xf + xi < 1}. 



G SI 



1,2x2 



( 


"1 

2 










3" 

4 












3 
_4 






G Pa \ Vr, 



so A{Xi,X2) h does not imply T{Xi,X2) h 0. On the other hand, T{Xi,X2) h does 
imply A{Xi, X2) ^ 0. We shall prove this later below, see Example 3.4. □ 

We now introduce subspaces to be used in our considerations: 

(3.4) Sj = span{I, Aj^e \ £ = !,..., g}^ SM^:- ^'^^ . 
Lemma 3.2. Sj = span{Lj{X) \ X GRf^}. 

The key tool in studying inclusions of matricial LMI sets is the mapping r we now define. 

Definition 3.3. Let Li,L2 be monic linear pencils as in (3.1). If {I, An \ i = l,...,g} is 
linearly independent (e.g. is bounded), we define the unital linear map 

(3.5) r : 5i ^ ^2, Ai^e ^ ^2,^ 
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We shall soon see that, assuming (3.2), r has a property called complete positivity, which 

be unital linear subspaces invariant under the transpose, 



we now introduce. Let Sj C 



and (/> : 5i — )• ^2 a unital linear *-map. For n E N, 



' 5i = 5" 



called an ampliation of (p. Equivalently, 

Tn • • • Tin 



i-nl 



onxn 
'^2 



XTll) 



induces the map 
M 



M (g)(t){A), 

(t>{Tnn). 



for Tij G Si. We say that (p is A;-positive if cpi^ is a positive map. If (j) is fc-positive for every 
A; G N, then (p is completely positive. If 0^ is an isometry for every k, then (f> is completely 
isometric. 



Example 3.4 (Example 3.1 revisited). The map r : ^2 — )• 

1 O] r -I To 1 O" 

^010, ^100 
-1 

1 L J 



Si in our example is given by 



1 
1 



1 

1 



1 



1 



Consider the extension of r to a unital linear *-map ip : 



En ^ 



1 1 
1 1 
1 



Ei2 ^ 



1 
1 

-1 



, E21 ^ 



1 



px2 





1 1 



5x3 



, defined by 







-E22 H> 



1 







-1 
1 
3 1 



(Here Eij are the 2x2 matrix units.) Now we show the map iJj is completely positive. To do 
this, we use its Choi matrix defined as 



(3.6) 



C 



mil) 

V'(^2l) 



i^{Ei2) 



[Pau02, Theorem 3.14] says ^p is completely positive if and only if C ^ 0. We will use the Choi 
matrix again in Section 4 for computational algorithms. To see that C is positive semidefinite, 
note 



C 



1, 



-W*W for W 



110 
11 



1 
-1 



Now ip has a very nice representation: 



(3.7) 

for all S G 

particular, 

(3.8) 



p2x2 



(Here Vi 



SVi + l^ 

1 1 
1 



1 


Vi 




5 0" 




Vi 


2 


V2 




S 




V2 



and Vo 



1 
-1 



thus W 



In 



2A(x, y) = Vi*Tix, y)Vi + V2*T{x, y)V2. 
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Hence r{Xi,X2) h implies A{Xi,X2) >z 0, i.e., Vr C Va- 

The formula (3.8) illustrates our linear Positivstellensatz which is the subject of the next 
subsection. The construction of the formula in this example is a concrete implementation of 
the theory leading up to the general result that is presented in Corollary 3.7. □ 

3.1. The map r is completely positive: Linear Positivstellensatz. We begin by equat- 
ing n-positivity of r with inclusion T>L-^{n) C T>L^{n). Then we use the complete positivity of 
r to give an algebraic characterization of pencils Li, L2 producing an inclusion 2?^^ C Di^^. 

Theorem 3.5. Let 

9 

Lj{x) = 1 + ^ Aj^iXi € SR'^^-^'^^ {x), j = 1,2 
i=\ 

be monic linear pencils and assume the matricial LMI set T>l^ is hounded. Let t : Si ^ S2 he 
the unital linear map Ai^i 1— t- A2/. 

(1) r is n-positive if and only ifT>L-^{n) C ^^^{n); 

(2) r is completely positive if and only ifT>L-^ C V^.^; 

(3) r is completely isometric if and only if dD^^ C ODl^^ 

We remark that the binding condition (3.3) used in (3) implies (3.2) used in (2) under 
the boundedness assumption; see Proposition 3.9. The proposition says that the relaxed dom- 
ination problem (see the abstract) can be restated in terms of complete positivity, under a 
boundedness assumption. Conversely, suppose V is a unital (self-adjoint) subspace of SM'^^'^ 
and r : P — )• SM.^ ^'^ is completely positive. Given a basis {/, Ai, . . . , Ag} for D, let Bj = T{Aj). 
Let 

Li=I + ^AjX.j, L2 = I + Y,BjXj. 

The complete positivity of r implies, if Li(X) >z 0, then L2{X) ^ and hence "Dli ^ ^L2- 
Hence the completely positive map r (together with a choice of basis) gives rise to an LMI 
domination. 

To prove the theorem we need a lemma. 

Lemma 3.6. Let L = I + Y,j=i AjXj £ SR'^'"^{x) be a monic linear pencil with bounded 
matricial LMI set T>l. Then: 

(1) ifA€ M"^" and X G (SM"^")9, and if 

(3.9) 5:=/0A + lW(X) 

is symmetric, then A = A*; 

(2) ifShO, then A h 0; 

(3) ifA£ M"^" and X £ (§M"^")9, and if 

9 

(3.10) T :=A0l + ^Xj0AjtO 
then A ^ 0. 
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Proof. To prove item (1), suppose 

a 

S = I A + ^Aj (g) Xj 
i=i 

is symmetric. Then = S — S* = I {A — A*). Hence A = A*. 

For (2), if A 0, then there is a vector v such that {Av,v) < 0. Consider the projection 
P onto M"^ (8) Mv, and let Y = {{Xjv, ^^))j=i G l^^- Then the corresponding compression 

psp = p{i(gA + {x))p = i(g, {Av, v) + (y ) h 0, 

which says that L^^\Y) >- 0. This implies ^ tY & Vl for all i > 0; contrary to Vi being 
bounded. 

Finally, for (3), we note that T is, after applying a permutation (often called the canonical 
shuffle), of the form (3.9). Hence A ^ by (2). ■ 

Proof of Theorem 3.5. In each of the three statements, the direction (=^) is obvious. We focus 
on the converses. 

Fix n G N. Suppose T € 5"^" is positive definite. Then T is of the form (3.10) for some 
A ^ and X G (SM"'^")^. By applying the canonical shuffle, 

S = I ® A + ^ Aij Xj >~ 0. 

If we change A to A + eJ, the resulting T = is in 5"^", so without loss of generality we may 
assume A :^ 0. Hence, 

(/0 A-^)5(/«) A-5) = i(g,i + ^Aij (g, (A-^XjA-i) >- 0. 

Condition (3.2) thus says that 

/«)/ + ^^2,j <S) (A-^XjA-^) h 0. 

Multiplying on the left and right by / (8) Aa shows 

I(S)A + J2 ^2,i <S) Xj t 0. 
Applying the canonical shuffle again, yields 

TiTe) = A<S)I + '^Xj® A2J h 0. 

Thus we have proved, if G ^5|*x'" ^j-^^j y 0, then t{T^) ^ 0. An approximation argument 
now shows if r ^ 0, then t(T) ^ and hence r is n-positive proving (1). Now (2) follows 
immediately. 

For (3), suppose T G 5"^" has norm one. It follows that 



W 



I T 
T* I 



>- 0. 
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From what has aheady been proved, r(VF) ^ and therefore t{W) has norm at most one. 
Moreover, smce W has a kernel, so does t{W) and hence the norm of t{T) is at least one. We 
conclude that r is completely isometric. ■ 

Corollary 3.7 (Linear Positivstellensatz). Let 

9 

Lj{x) = I + Aj^ixi G SW^^ '^^ (x) , J = 1 , 2 

he monic linear pencils and assume T)l^ is hounded. If (3.2) holds, that is, if Li[X) ^ 
implies L2{X) >z for all X, then there is i-i N and an isometry V G ]KA'"'i><'^2 ^y^/i that 

(3.11) L2ix) = V*{lf,(S>Li{x))V. 
Conversely, if fi,V are as ahove, then (3.11) implies (3.2) holds. 

Remark 3.8. Before turning to the proof of the Corollary, we pause for a couple of remarks. 

(1) Equation (3.11) can be equivalently written as 

(3.12) L2ix) = Y,yj*Liix)Vj, 

i=i 

where Vj G ^nd V = coliVi, . . . ,V^). Since Ej=i^/^i = ^d^, V is an isometry. 

Moreover, ^ can be uniformly bounded (see the proof of Corollary 3.7, or Choi's charac- 
terization [Pau02, Proposition 4.7] of completely positive maps between matrix algebras). 
In fact, /i < did2. 

(2) Corollary 3.7 can be regarded as a Positivstellensatz for linear (matrix valued) polynomials, 
a theme we expand upon later below. Indeed, (3.12) is easily seen to be equivalent to the 
more common statement 

(3.13) L2{x) = B + Y, W*Li{x)Wj 

i=i 

for some positive semidefinite B G SM'^^xda ^nd Wj G M'^i^'^^. 

If we worked over C, the proof of Corollary 3.7 would proceed as follows. First invoke 
Arveson's extension theorem [Pau02, Theorem 7.5] to extend r to a completely positive map 
-0 from di X di matrices to d2 x d2 matrices, and then apply the Stinespring representation 
theorem [Pau02, Theorem 4.1] to obtain 

(3.14) i;{a) = V*Tr{a)V, a e C^'""^^ 

for some unital *-representation vr : C'^^^'^^ — t- C'^^^'^^ and isometry (since r is unital) V : 
C^^ — )• C^^. As all representations of C^'-^'^^ are (equivalent to) a multiple of the identity 
representation, i.e., 7r(a) = a for some /i G N and all a G C'^i^'^i, (3.14) implies (3.11). 

However, in our case, the pencils Lj have real coefficients and we want the isometry V to 
have real entries as well. For this reason and to aid understanding of this and our algorithm 
Section S 4 we present a self-contained proof, keeping all the ingredients real. 
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We prepare for the proof by reviewing some basic facts about completely positive maps. 
This serves as a tutorial for LMI experts, who often are unfamiliar with complete positivity. 
Linear functionals a : R'^i^'^i(g)M'^2xd2 _^ ^re in a one-one correspondence with mappings 

(3.15) {'4!{Eij)ea, Cb) = {ip{eie*)ea, e^) = cr{eje* 6^6^). 

Here, with a slight conservation of notation, the e^, ej are from {ei, . . . , e^^} and e^, are from 
{ca, . . . , e^j} which are the standard basis for M.'^'^ and M.'^^ respectively. 

Now we verify that positive functionals a correspond precisely to completely positive 
and give a nice representation for such a ip. 

A positive functional a : R'^ix^i ® ]^d2xd2 ^ j^didaxdida _^ ]^ corresponds to a positive 
semidefinite did2 x did2 matrix C via 

a{Z) = tr(ZC). 

Express C = {Cpq)^^^^^ as a di x di matrix with d2 x d2 entries. Thus, the (a, 5) entry of the 
(i, j) block entry of C is 

{Cij)ab = {C{ej (g) Ca), Ci (g) eft). 

With Z = (cj ea){ei Cg) e;,)* observe that 

{'ip{Eij)ea, eb) = cr{eje* (g) Sael) = tr(ZC) = {C{ej (g> Ca), (g) Cb) = (CijCa, Cb). 
Hence, given S = (sij) = Yli)=i ^ij^iji t>y the linearity of -0, 

(The matrix C is the Choi matrix for ■0, illustrated earlier in (3.6).) The matrix C is positive 
and thus factors (over the reals) as W*W . Expressing W = (Wij)f as a di x di matrix with 
d2 X d2 entries Wij, 

di 

Define Vi = (Wa). Then we have a positive implies 

d2 di d2 di 

(3.16) V(S) = J2 '^i^i^ = J2Y1 W*,SijWji = J2 Ve*SVe = V*{{Id, 5) I^,) F, 

i,j=l 1=1 i,j=l 1=1 

where V denotes the column with £-th entry V^. Hence ij) is completely positive. 

Proof of Corollary 3.7. We now proceed to prove Corollary 3.7. Given r as in Theorem 3.5, 
define a linear functional a : 5i ^M'^^xda ^ ]R as in correspondence (3.15) by 

a{S y) = ^(yeb, ea){T{S)eb, e,). 

a,b 
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Suppose Z = Sk(E>Yk € cSi (g)M°'2xd2 positive semidefinite and let e = Ylt=i^a^ Ga- Since 
the map r^-^ = /^^ (X" r, cahed an ampUation of r, is positive, 

0<{Td,iZ)e,e) = aiZ). 

Thus a is positive and hence extends to a positive mapping a : ^ ^d.2xd2 _^ ]^ ]-,y 

the Krein extension theorem, which in turn corresponds to a completely positive mapping 
^ . ^dixdi _^ ^d2xd2 (3.15). It is easy to verify that ip\s^ = r. By the above, 

il;{S) = V*{{Id,^S)^Id,)V. 

Since ^(/) = /, it fohows that V*V = I. ■ 

3.2. Equal matricial LMI sets. In this section we begin an analysis of the binding condition 
(3.3). We present an equivalent reformulation: 

Proposition 3.9. Let Li, L2 be monic linear pencils. IfV^^ is bounded and (3.3) holds, that 
is, if &Dl^ C dVi^ , then = • 

The proof is an easy consequence of the following elementary observation on convex sets. 

Lemma 3.10. Let Ci C C2 C M" be closed convex sets, G int Ci n intC2. If dCi C 9C2 
then Ci =6*2. 

Proof. By way of contradiction, assume Ci C C2 and let a G C2 \ Ci. The interval [0, a] 
intersects Ci in [0, /xa] for some < /x < 1. Then //a G dCi C dC2. Since G intCi, Ci 
contains a small disk D(0, e). Then := co(D(0, e) U {a}) is contained in C2 and //a G 
int X C int C2 contradicting /ia G (?C2 . ■ 

Proof of Proposition 3.9. Let Ci := T>l-, i = 1,2. Then 

dCi = {Xe Vl, I L^{X) >z 0, L,{X) ^ 0}. 

Since Ci is closed and bounded, it is the convex hull of its boundary. Thus by (3.3), Ci C C2. 
Hence the assumptions of Lemma 3.10 are fulfilled and we conclude Ci = C2. ■ 

Example 3.11. It is tempting to guess that V^^ = V^^ implies Li and L2 (or, equivalently, 
L^l^ and i^2^^) are unitarily equivalent. In fact, in the next subsection we will show this to 
be true under a certain irreducibility-type assumption. However, in general this fails for the 
trivial reason that the direct sum of a representing pencil and an "unrestrictive" pencil is also 
representative. 

Let L\ be an arbitrary monic linear pencil (with bounded) and 



L2{x) = I+{L^l\x)®^-L{'\x)) 



1 



'l + L^l\x) 






/ + iLW(x) 



Li{x) 
I+\L^l\x) 



Then = T)l^ but Li and L2 are obviously not unitarily equivalent. However, 



Li{x) 



I 




L2{x) 



I 
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in accordance with Corollary 3.7. 

Another guess would be that under T>l-^ = T)l^, we have p = 1 in Corollary 3.7. However 
this example also refutes that. Namely, there is no isometry V G ]^<^ix2rfi satisfying 

'Li{x) 
I + \L^l\x) 

(Here Li is assumed to be a di x di pencil.) □ 

3.3. Minimal L representing Vl are unique: Linear Gleichstellensatz. Let L = I + 

^ AiXi be a d X d monic linear pencil and S = span{/, \ i = 1, . . . , g}. In this subsection 
we explain how to associate a monic linear pencil L to L with the following properties: 

(a) = Vl; 

(b) L is the minimal (with respect to the size of the defining matrices) pencil satisfying (a). 

A pencil L = / + ^ ^j^j is a subpencil of L provided there is a nontrivial reducing 
subspace % for S such that Aj = V*AjV, where V is the inclusion of H into M*^, where d is 
the size of the matrices Aj. The pencil L is minimal if there does not exist a subpencil L 
such that T>L = D^. 

Theorem 3.12. Suppose L and M are linear pencils of size d x d and e x e respectively. If 
T>L =T^M is hounded and both L and M are minimal, then d = e and there is a unitary d x d 
matrix U such that U*LU = M ; i.e., L and M are unitarily equivalent. 

In particular, all minimal pencils for a given matricial LMI set have the same size {with 
respect to the defining matrices) and this size is the smallest possible. 

Example 3.13. Suppose L and M are only minimal with respect to the spectrahedra T>l{1) 
and T>m{^), respectively. Then 2?l(1) = T^m{^) does not imply that L and M are unitarily 
equivalent. For instance, let L and M be the two pencils studied in Example 3.1. Then both 
L and M are minimal, T)l{1) = 25^/(1), but L and M are clearly not unitarily equivalent. □ 

The remainder of this subsection is devoted to the proof of, and corollaries to. Theorem 
3.12. We shall see how Vl is governed by the multiplicative structure (i.e., the C*-algebra) 
C*{S) generated by S as well as the embedding S ^ C*{S). For this we borrow heavily from 
Arveson's noncommutative Choquet theory [Arv69, Arv08, ArvlO] and to a lesser extent from 
the paper of the third author with Dritschel [DM05] . 

We start with a basics of real C*-algebras needed in the proof of Theorem 3.12. First, the 
well-known classification result. 

Proposition 3.14. A finite dimensional real C* -algebra is ^-isomorphic to a direct sum of 
real ^-algebras of the form M„(]R), M„(C) and M„,(]HI). {Here the quaternions HI are endowed 
with the standard involution.) 

Proposition 3.15. Let K G {M,C,EI} and let <l> : M„(K) — M„(]K) be a real * -isomorphism. 



= L2{x) = V*Li{x)V. 
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(1) IfK£ {1R,EI}, then there exists a unitary U G M„(]K) with ^{A) = U*AU for all A e 
Mn{K). 

(2) For K = C, there exists a unitary U G M„(C) with ^{A) = U*AU for all A £ M„(C) or 
^{A) = U*AU for all A G Af„(C). {Here A denotes the entrywise complex conjugate of 
A.) 

Proof. In (1), Mn{K) is a central simple R-algebra. By the Skolem-Noether theorem [KMRT98, 
Theorem 1.4], there exists an invertible matrix U G M„,(]fC) with 

(3.17) ^{A) = U-^AU for ah A G Mn{K). 

Since is a *-isomorphism, 

U"^A*U = ^{A*) = ^{Ay = {U~^AU)* = U*A*U~\ 

leading to UU* being central in Af„(]K). By scaling, we may assume UU* = /, i.e., U is unitary. 

(2) <l>(i) is central and a skew-symmetric matrix, hence <I>(i) = ai for some a G M. 
Moreover, (^{i?) = —1 yields = 1. So $(i) = i or <I>(z) = —i. In the former case, $ is a 
*-isomorphism over C and thus given by a unitary conjugation as in (1). If ^{i) = —i, then $ 
composed with entrywise conjugation is a *-isomorphism over C. Hence there is some unitary 
U with ^>(^) = U*AU for aU ^ G M„(C). ■ 

Remark 3.16. For K G {M,C,BI}, every real *-isomorphism $ : M„(]K) Mn{K) lifts to a 
unitary conjugation isomorphism M^niM) ^dni^)^ where d = dimsK. By Proposition 3.15, 
this is clear if i^T G {M, H}. To see why this is true in the complex case we proceed as follows. 

Consider the standard real presentation of complex matrices, induced by 



(3.18) 



C ^ Mo 



a + i 6 I— )■ 



a b 
—b a 



If the real *-isomorphism # : M„(C) — )• M„(C) is itself a unitary conjugation, the claim is 
obvious. Otherwise $ is conjugation by some unitary U G M„(C) and thus has a natural 
extension to a *-isomorphism 



$ : M' 



2n 



M' 



Then 



$ : M' 



2n 



M' 



2n 



2n 



A^ i In 



A^ i{U)*AL{U). 



HA) /„ 



is a unitary conjugation *-isomorphism of M2n(K) and restricts to on M„(C). 

Let K be the biggest two sided ideal of C*{S) such that the natural map 
(3.19) C*{S) ^ C*{S)/K, a^d:=a + K 

is completely isometric on 5. is called the Silov ideal (also the boundary ideal) for S in 
C*{S). Its existence and uniqueness is nontrivial, see the references given above. The snippet 
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[Arv+] contains a streamlined, compared to approaches which use injectivity, presentation of 
the Silov ideal based upon the existence of completely positive maps with the unique extension 
property. While this snippet, as well as all of the references in the literature of which we are 
aware, use complex scalars, the proofs go through with no essential changes in the real case. 

A central projection P in C*{S) is a projection P G C*{S) such that PA = AP for all 
A G C*{S) (alternately PA = AP for all A ^ S). We will say that a projection Q reduces 
or is a reducing projection for C*{S) if QA = AQ for all A G C*{S). In particular, P is a 
central projection if P reduces C*{S) and P G C*{S). 

Proposition 3.17. Let L be a d x d truly linear pencil and suppose Dl is bounded. Then L 
is minimal if and only if 

(1) every minimal reducing projection Q is in fact in C*{S); and 

(2) the Silov ideal ofC*{S) is (0). 

Proof. Assume (1) does not hold and let Q be a given minimal nonzero reducing projection for 
C*(5), which is not an element of C*{S). Let P be a given minimal nonzero central projection 
such that P dominates Q] i.e., Q ^ P. By our assumption, Q ^ P. 

Consider the real C*-algebra A = C*{S)P as a real *-algebra of operators on the range 
Ti of P. First we claim that the mapping A B A AQ is one-one. If not, it has a nontrivial 
kernel J which is an ideal in A. The subspace /C = JTi reduces A and moreover, because of 
finite dimensionality, the projection R onto /C is in fact in A. Hence, i? is a central projection. 
By minimality, R = P or R = (0). In the second case the mapping is one-one. In the first 
case, JTi = % and thus J = C*(5)P; i.e., the mapping C*{S)P B A^ AQ is identically zero. 
In this case, the mapping C*{S)P 3 A^ A{I — Q) is completely isometric, contradicting the 
minimality of L. Hence the map A3 A^ AQ is indeed one-one. 

Therefore, the mapping C*{S) 3 A ^ A{I — P) + AQ is faithful and in particular com- 
pletely isometric. Thus the restriction of our pencil to the span of the ranges of I — P and 
Q produces a pencil L' with P^/ = V^, but of lesser dimension. Thus, we have proved, if (1) 
does not hold, then L is not minimal. 

It is clear that if the Silov ideal of C*{S) is nonzero, then L is not minimal. Suppose 
J C C*{S) is an ideal and the quotient mapping o" : 5 — t- C*{S)/J is completely isometric. 
As before, let K, = JW^ (where the pencil L has size d). The projection P onto /C is a central 
projection. Because for G 5 we have both a{S) = a{S — SP), and a is completely isometric, 
it follows that S S{I — P) is completely isometric. By the minimality of L, it follows that 
P = 0. 

Conversely, suppose (1) and (2) hold. If L is not minimal, let L denote a minimal subpencil 
with T?^ = T>L, corresponding to a reducing subspace /C C R'^ for S. Let Q denote the projection 
onto /C and T denote {SQ \ S G 5}. Note that the equality Vj^ = T>l says exactly that the 
mapping S ^ T given by S i— t- SQ is completely isometric. In particular, if R is the projection 
onto a reducing subspace which contains /C, then also S i— ?• SR is completely isometric. 
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Let P : —7- JC' denote any minimal orthogonal projection onto a reducing subspace 
of JC^. By (1), P E C*{S), and hence C*{S)P is a (minimal) two-sided ideal of C*{S). On 
the other hand, (/ — P) is the projection onto a reducing subspace which contains K, and 
hence S i— )• S{I — P) is completely isometric. Now let S = (Sij) G Mn{S) be given. If 
T = {Tij){In ® P) G Mn{C*{S))P, then 

\\S + r|| = \\S{In P)) ®{S + T){In ®P)\\> \\S{In ® {I - P))\\ = \\S\\, 

where the last equality comes from the fact that 5 i— t- S{I — P) is completely isometric and 
the inequality from the fact that the norm of a direct sum is the maximum of the norm of the 
summands. Of course choosing T = S{In <8> P) it follows that the norm of S in the quotient 
C*{S)/C*{S)P is the same as \\S\\. Hence the induced map S C*{S)/C*{S)P is completely 
isometric and therefore C*{S)P is contained in the Silov ideal of S, contradicting (2). ■ 

Proof of Theorem 3.12. Write L = I + T^^j^j and M = 1 + T.BjXj and let C*{S) and C*(r) 
denote the unital C*-algebras generated by {^i, . . . , Ag} and {Bi, . . . , Bg} respectively. By 
Proposition 3.17, both C*{S) and C*{T) are reduced relative to S and T respectively; i.e., the 
Silov ideals for S and T respectively are (0). 

Moreover, for Q and V maximal families of minimal nonzero reducing projections for 
C*{S) and C*{T) respectively, we use Proposition 3.17 to obtain 

C*iS) = eQ^QC*iS)Q, C*{T) = epepC*{T)P 

For later use we note that a minimal ideal in these C*-algebras is of the form C*{S)Q for 
Q € Q, and C*{T)P for P G respectively. 

The unital linear *-map 

T :S ^T, Aj Bj 

is a completely isometric isomorphism by Theorem 3.5 and maps between reduced operator 
systems. By [Arv69, Theorem 2.2.5], r is induced by a *-isomorphism 

p : C*{S) C*{T). 

Since p is an isomorphism of C*-algebras and C*{S)P for P £ V, is a minimal ideal, 
(3.20) p{C*{S)P) = C*{T)Q 

for some Q G Q- The converse is true too. That is, for each Q £ Q there is a unique P € V 
such that (3.20) holds. We conclude that d = e. 

By Proposition 3.15 and Remark 3.16 we also conclude that the C*-isomorphism p : 
C*{S)P — >• C*{T)Q must be implemented by a unitary mapping RanP — )• RanQ. ■ 

Corollary 3.18. Let L e SM'^'"^(x) be a monic linear pencil with boundedVL and L G SM^^^(x) 
its minimal pencil. Then there is a (d — i) x (d — i) monic linear pencil J satisfying J\t>l — 
and a unitary U G M'^^'^ such that 

J{x) 



L{x) = U* 



U. 
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Proof. Easy consequence of the construction of L. ■ 

4. Computational algorithms 

In this section we present several numerical algorithms using semidefinite programming 
(SDP) [WSVOO], based on the theory developed in the preceding section. However, one can 
read and implement these algorithms without reading anything beyond Section 1.3 of the 
introduction. In each case, we first present the algorithm and then give the justification (which 
a user need not read). The following section. Section 5, provides comparisons and refinements 
of the matricial matrix cube algorithm of Subsection 4.5 below. 

Given Li and L2 monic linear pencils 

a 

(4.1) {x) = I + Y, Aj/^i G SM'^^x'^^ (x), j = l, 2, 

e=i 

with bounded matricial LMI set 1*1,1, present an algorithm, the inclusion algorithm, 

to test whether T)i^ ^ Vl^. Of course this numerical test yields a sufficient condition for 
containment of the spectrahedra 'Dli(I) ^ ^^2(1)- We refer the reader to Section 4.4 for 
a test of boundedness of LMI sets, which works both for commutative LMIs and matricial 
LMIs, and computes the radius of a matricial LMI set based on the basic inclusion algorithm. 
Subsection 4.2 contains a refinement of the basic inclusion algorithm, in the case that either Li 
or L2 is a direct sum of pencils of smaller size. As an application, we then present a matricial 
version of the classical matrix cube problem in Section 4.5. Analysis of the matricial matrix 
cube algorithm are in Section 5 along with a comparison to the matrix cube algorithm of 
Ben-Tal and Nemirovski [B-TN02]. There further algorithms, which offer improved estimates, 
at the expense of additional computation, for the matrix cube problem are also discussed. 
The final subsection of this section gives a (generically successful) algorithm for computation 
of a minimal representing pencil and the Silov ideal, these being the only algorithms whose 
statement is not self contained. 

4.1. Checking inclusion of matricial LMI sets. 

The inclusion algorithm 

Given: Ai^£ and A2/ for £ = 1, . . . , g. Let ^ denote the {p,q) entry of ^i/. 
Solve the following (feasibility) SDP: 

(4.2) (cp,)J^^i := C ^ 0, X^cpp = /d,, V^ = l,...,fi: ^a^,cp, = ^2,£, 

p p,q 

for the unknown symmetric matrix C. Since each Cpq is a M'^2X(i2 niatrix, the symmetric matrix 
C of unknown variables (reasonably termed the Choi matrix) is of size did2 x did2 and there are 
^did2{did2 + 1) (scalar) unknowns and ^(1 + g)d2{d2 + 1) (scalar) linear equality constraints. 
This can be, in practice, solved numerically with standard SDP solvers. In the next subsection, 
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we show that if Li has special structure, then the number of (C) variables can be reduced, 
sometimes dramatically. 

Conclude: "Dli ^ if &iid only if the SDP (4.2) is feasible, i.e., has a solution. 

Justification. By Theorem 3.5 and Corollary 3.7, L2 is positive semidefinite on T>Li if and 
only if there is a completely positive unital map 

(4.3) ^ : M'^i'^'^i ^ M'^^xdz 
satisfying 

(4.4) r(^i,,) = ^2/ for e = l,...,g. 

To determine the existence of such a map, consider the Choi matrix C = {T{Eij)^'^\_^ E 
^^d2xd2'jdixdi Qf (Here, Eij are the di xdi elementary matrices.) For convenience of notation 
we consider C to be a di x di matrix with d2 x d2 entries Cij. This is the matrix C which 
appears in the algorithm. It is well-known that r is completely positive if and only if C is 
positive semidefinite [Pau02, Theorem 3.14]. 

Note that we can write = Y,p,g oipq^pq- Then t{Ai^i) = Y,p^q apqT{Epq) = Y^p^q oipq^pq- 
This lays behind the last equation in (4.2). If a solution C to (4.2) has been obtained, then 
a Positivstellensatz-type certificate for the inclusion of the matricial LMI sets T>l^ ^T^l^ can 
be obtained; cf. Example 3.4 or the proof of Corollary 3.7. ■ 



4.2. LMIs which are direct sums of LMIs. If either pencil Lj as in (4.1) is given as a 
direct sum of pencils, then the Choi matrix C in the inclusion algorithm can be chosen with 
many fewer unknowns, reflecting this structure. We start with Li. 

Proposition 4.1. Suppose Li = ®^=iM^, where Mi, . . . ,Mk are monic linear pencils, 



where the are of size x 5^. Thus, Ai^i = ®^=i-B^. Let apg denote the {p,q) entry of 



B^. Then, ^ T^L2 ^/ ^''^d only if there exists a symmetric matrix C = (B^^iC^ such that 



(4.5) 



k 

W = l,...,g: af;i;c^q = A2,i, 

M=lp,9=l 

k ^fi 

5Z 5Z ^PP ~ ^'^'^ ' 
f_i=l p=l 



Each Cpq is an unknown d2 x d2 matrix and (cpg)* = (cgp). 
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Proof. The inclusion C is equivalent to the existence of a Choi matrix C satisfying 
the feasibility conditions (4.2) of the inclusion algorithm. Thus C is a di x di block matrix 
with d2 X d2 entries. On the other hand, di = 6^ and the matrix C can be viewed as a 
block matrix C = {Cij)^j where Cij is 5i x 6j block matrix whose entries are d2 x d2 matrices. 
Observe that for i ^ j, the entries of Cij do not appear as part of the linear constraint in the 
inclusion algorithm - they are unconstrained because our direct sum structure forces certain 
Opq to be zero. 

Since di = X] and the matrix C is a di x di block matrix with d2 x d2 blocks and is 
positive semidefinite, hence there exist di x 5^ block matrices VF^ having d2 x d2 entries such 
that C factors as 



C = W*W 



Consider the set C of 2^^ ^ matrices of the form 



Wx ±W2 ±W^ 



Each C G C solves the inclusion algorithm; i.e., validates C Vi^. Hence the matrix 

C obtained by averaging over C also validates the inclusion. Noting that, because each off 
diagonal entry of C is the average of 2^~^ terms W^Wj with 2^""^ terms —W*Wj, we get C is 
the block diagonal matrix with diagonal entries W*Wj, which completes the proof. ■ 



With the hypotheses of Proposition 4.1, the number of unknown variables in the LMI 
inclusion algorithm are greatly reduced. Indeed, from ^{did2 + l)did2, to 

1 

-Y,id26f, + l)d25f,. 

The number of equality constraints is still ^(1 + g)d2{d2 + !)• 

A reduction in both the number of variables and equality constraints occurs if L2, the 
range linear pencil, in the inclusion algorithm has a direct sum structure. 

Proposition 4.2. In the inclusion algorithm, if the pencil L2 is a direct sum; i.e., L2 = 
(Bf^=lM^, where each 

1 
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is a monic linear pencil of size 6^ x 6f^ {so that = d2), then T)l^ C if and only if 

there exists a symmetric matrix C = ©^^^C^ such that 

V/i=l,...,fc: C^:={c^^X]i=i^^^ 

dfj, 

y£=l,...,g, fi=l,...,k: J^a^gC^, = i?;, 

(4-6) p,g=l 

p=i 

Each Cpq is an unknown 5^ x 5^ matrix and (cpq)* = (cqp). 

The count of unknowns is ^ X]J^=i('^i^^t + ^)di6^ and of scalar equality constraints is 
gk6^{6f, + l) + k5f,i5f, + l). 

4.3. Tightening the relaxation. There is a general approach to tightening the inclusion 
algorithm which relaxes C 'Dl^{1), and thus applies to the algorithms in the section, 
based upon the following simple lemma. 

Lemma 4.3. Suppose Li, L2 and M are linear pencils and let Ad = Li(BM. //Pj^-^(l) QD]\f(l), 
then 

Vj^jQVl, and V^,j{1)=Vl,{1). 
In particular, ifD^j ^ ^^2? then 25^^(1) C V^^^l). 

Proof. The first part of the lemma is evident: 

Likewise, Vj^^{l) = (1) n Pm(1) = ^Li(l), since Vl^{1) C Vm{1)- For the last statement 
note that Vj^j C Vl^ implies Vl^{1) = ^^^(l) C Pl2(1). ■ 

This lemma tells us applying our inclusion algorithm to M versus L2 is at least as accurate 
as applying it to Li versus M and it quite possibly is more accurate. The lemma is used in 
the context of the matrix cube problem in Section 5. 

4.4. Computing the radius of matricial LMI sets. Let L be a monic linear pencil, 

a 

(4.7) L(x) = / + J^^^rEf eSM"'^'^(x). 

e=i 

We present an algorithm based on semidefinite programming to compute the radius of a matri- 
cial LMI set Dl (and at the same time check whether it is bounded). The idea is simply to use 
the test in Section 4.1 to check if Dl is contained in the ball of radius N. The smallest such 
will be the matricial radius, and also an upper bound on the radius of the spectrahedron 
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Let 



/ , 1 
Jn{x) = — 



N X* 

X Nig 



be a monic linear pencil. Here E[j the {g + \) y. {g + 1) elementary matrix with a 1 in the (i, j) 
entry and zeros elsewhere. 

Then T>l is bounded, and its matricial radius is < N ^ if and only if T>j^ 5 T>l. 

The matricial radius algorithm 

Let af denote the (r, s) entry of A^, that is, = X^,^^ a^^Ers. Solve the SDP (RM): 
min 6 := Q^^(crs)i,2 subject to 

(RMi) {Crs)f,s=l-=ChO, 
(RM2) ECrr = /9+l, 

(RM3) W = l,...,g, Vp,(7 = l,...,5 + 1 : 

^af,(c,,)p,g = for {(!,£ + 1), (^ + 1,1)}, 

r,s 

(RM4) X]r,s "rs(Crs)l,2 = Er,s ars(Crs)2,l = Er,s "rs(Crs)l,3 = Er,s ars(Crs)3,l = " " " 

for the unknown C; i.e., the unknown (g + 1) x ((7 + 1) matrices (c^s). If the optimal value 
of (RM) is 6 € M>o, then ||X|| < ^ for all X G 2?^, and this bound is sharp. 

This SDP is always feasible (for b = J2r s'^rs{'^rs)i,2 = 0). Clearly, Vl is bounded if and 
only if this SDP has a positive solution. In fact, any value of 6 > obtained gives an upper 
bound of ^ for the norm of an element mVi. The size of the (symmetric) matrix of unknown 
variables is d{g + 1) x d{g + 1) and there are ^{g^ + 4g'^ +3(7 + 4) (scalar) linear constraints. 
To reduce the number of unknowns, solve the linear system of \g{g'^ + 3(7 — 2) equations given 
in (RM3). 

Checking boundedness of Pi(l) is a classical, fairly basic semidefinite programming prob- 
lem. Indeed, given a nondegenerate monic linear pencil L, T>l{1) is bounded (equivalently, Vl 
is bounded) if and only if the following SDP is infeasible: 

l(i)(X)>iO, tr (l(i)(X)) = 1. 



(Here, L^^^ denotes the truly linear part of L.) 

However, computing the radius of T)l[1) is harder. Thus our algorithm, yielding a conve- 
nient upper bound on the radius, might be of broad interest, motivating us to spend more time 
describing its implementation. The algorithm can be written entirely in a matricial form which 
is both elegant and easy to code in MATLAB or Mathematica. The matricial component of 



24 



HELTON, KLEP, AND MCCULLOUGH 



the algorithm is as fohows. Let e„ denote the vector of length n with all ones, let E„ = e„ Cgie^ 
be the n x n matrix of all ones. Then (RM2) is (using "h for the Hadamard product) 

(e^+i (g) Id)\{Id ^ -H C) (eg+i (g) Id) = Ig+i, 

while the left hand side of (RM3) can be presented as the {p, q) entry of 

(eg+i Id) * ( {Ai ® Eg+i ) .H C) (eg+i ® Id) . 

Equations (RM3) and (RM4) give constraints on these matrices. 

As an example we computed the matricial radius of an ellipse, which for the example we 
computed agrees with the scalar radius. The corresponding Mathematica notebook can be 
downloaded from 

http : //srag. fmf .uni-lj . si/preprints/ncLMI-supplement . zip 

Justification. As in the previous subsection, we need to determine whether there is a com- 
pletely positive unital map r : M'^^'^ m(3+i)x(9+i) satisfying T{Aj) = j^{E[ j^^ + ^j+1,1) for 
some N. The Choi matrix here is C = {T{Eij))ij £ (]R(3+i)x(3+i)^<ixd_ ^ Er,^«rs^r-s- 

Then the linear constraints we need to consider say that 

r,s 

has all entries except for the (1, £ + 1) and {i + 1, 1) entries which are the same; indeed they 
are all equal to Thus we arrive at the feasibility SDP (RM) above. ■ 

4.5. The matricial matrix cube problem. This section describes our matricial matrix cube 
algorithm - a test for inclusion of the matricial matrix cube (as defined below) into a given 
LMI set. Variations on the algorithm and an analysis of the connection between this algorithm 
and the matrix cube algorithm of [B-TN02] is the subject of Section 5. 

Let L G SM'^^'^(x) be a monic linear pencil as in (4.7). We present an algorithm that 
computes the size p of the biggest matricial cube contained in P^. That is, p E M is the largest 
number with the following property: if n S N and X £ (SM"'^")^ satisfies \\Xi\\ < p for all 
i = 1, ... ,5, then X G P^. When Xi is in R^^^ this is the classical matrix cube problem 
(cf. Ben-Tal and Nemirovski [B-TN02]), which they show is NP-hard. 

First we need an LMI which defines the cube. Let 

Cp(x) = i (( ©f^i p - X,) ( ©f^i p + X,)) G m's-^^ix). 

Then Cp{x) = / + ^ X^j=i(-E'jj — ^g+j,9+j)^jj where Eij is a the elementary 2g x 2g matrix 
with a 1 in the {i,j) entry and zeros elsewhere, and 

= U ^ (SM'^^'^)^ I ||X,|| < p for alH = 1, . . . ,5} . 

This is a matricial cube. Our algorithm uses the test in Section 4.1 to compute the largest p 
with ^ T>L. It also takes advantage of the fact that Cp is a direct sum (of scalar- valued 
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pencils) by using Proposition 4.1 with k = 2g, 5^ = 1 and d2 = d. This immediately gives rise 
to the following SDP: 

max/9 subject to 

(preMCi) C^hO, j = l,...,2g 

(preMCa) yj = l,...,g: 0-C9+i = pAj. 

(preMCa) ^ = h, 

Each of the 2g symmetric matrices is in SM'^^'^. 

Next we make this algorithm more efficient by solving the equality constraints (preMC2) 
to eliminate C^"*"^, . . . , C^^ and (preMCs) to obtain 

g—l g 

(4.8) c^ = Ji.2Y,C^+pY,A,) 

i=i i=i 

With this, the above SDP reduces to 

The matricial matrix cube algorithm 

max p subject to 

(MCi) C^VO, i = l,...,g-l 
(MC2) >z pAj 

(MC3) h - 2 + Mi ± pAg h 0, 

where each of the g—l symmetric matrices is in SM'^^'^. 

This SDP is always feasible (with p = 0). If its optimal value is /? > 0, then T^Cp ^ ^L, and 
the obtained upper bound for the size of the matricial cube is sharp. There are ^{g — l)d{d+l) 
variables and all of the linear equality constraints have been eliminated. There are 2g matrix 
inequality constraints. 

Example 4.4. Consider finding the largest square embedded inside the unit disk. We consider 
the two pencils A,r from Example 3.1, each of which represents the unit disk, since ^?a(1) = 
Vril) = {{Xi,X2) G I Xf + X| < 1}. It is clear that Pc^^^(l) is the maximal square 
contained in the unit disk 'Da(I)- Indeed the biggest matricial cube in Pa is Pc^^j' 
biggest matricial cube in is T>Ci ■ For details, see the Mathematica notebook available at 

http : //srag. fmf .uni-lj . si/preprints/ncLMI-supplement . zip 
We will revisit this example in Section 5. □ 

Justification. A justification for the matrix cube algorithm based on the pre-algorithm 
has already been given. So it suffices to justify the pre-matricial matrix cube algorithm. 
Let Bj := Ejj - Eg^j^g^j G SM^^^^-y^ Taking advantage of the fact that Cp is the direct 
sum of 2g scalar linear pencils, we want to determine the biggest p for which there exists a 
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completely positive unital map r : ©^^M^^^ — )• R'^-^'^ satisfying T{Bj) = pAj, j = l,...,g. 
Suppose C = ©jli(c-') G (Bi^ {M.'^^'^y^^ (because each cMs a 1 x 1 block matrix whose entries 
are (symmetric) d x d matrices, there is no need for the indexing Cpg) is the corresponding 
Choi matrix as in Proposition 4.1. Then the linear constraint T{Bj) = pAj translates into 
Cii — c^ii^ = pAj which is (preMC2). ■ 

4.6. Minimal pencils and the Silov ideal. This section describes an algorithm aimed at 
constructing from a given pencil L a pencil L of minimal size with T>l = T^i- 

4.6.1. Minimal pencils. Let L be a monic linear pencil, 

9 

(4.9) L(x) = / + J];^x^gSM'='^'^(x) 

1=1 

with bounded Vi. We present a probabilistic algorithm based on semidefinite programming 
that computes a minimal pencil L with the same matricial LMI set. 

The two-step procedure goes as follows. In Step 1, one uses the decomposition of a 
semisimple algebra into a direct sum of simple algebras, a classical technique in computational 
algebra, cf. Friedl and Rohyal [FR85], Eberly and Giesbrecht [EG96], or Murota, Kanno, 
Kojima, and Kojima [MKKKIO] for a recent treatment. This yields a unitary matrix U € W^^'^ 
that simultaneously transforms the A^ into block diagonal form, that is, 

U*A(,U = ®j=iBj for all £. 

For each j, the set {I,Bl, . . . , Bg} generates a simple real algebra. Define the monic linear 
pencils 

9 

L\x) = I + ^Bixi, L'{x) = U*L{x)U = ®'j^iV{x). 
Given i, let = (Bj-tiL^ ■ If there is no i such that 

(this can be tested using SDP as explained in Section 4.1) then the pencil is minimal. If there 
is such an (. remove the (one) corresponding block from L' to obtain a new pencil and repeat 
the process. Once we have no more redundant blocks in L', the obtained pencil L is minimal, 
and satisfies T)j^ = T>l hy construction. 

4.6.2. Silov ideal. Thus subsection requires material from Section 3. Using our results from 
Section 3.3 (cf. Proposition 3.17) and Section 4.1, one can compute the Silov ideal of a unital 
matrix algebra A generated by symmetric matrices Ai, . . . , Ag G SM'^^'^. Form the monic linear 
pencil 

L = I + '^AiXi G SR'^'"^{x), 
and compute the minimal pencil 

L = I + Y^ Aexi 



THE MATRICIAL RELAXATION OF AN LMI 



27 



as in the previous subsection. If 

S = span{/, Ai\i=l,...,g}, 
then the kernel of the canonical unital map 

is the Silov ideal of A. 

5. More on the matrix cube problem 

This section provides perspective on the inclusion algorithm by focusing on the matrix 
cube problem. The first subsection shows that the estimate based on the inclusion algorithm, 
namely the matricial matrix cube algorithm of Subsection 4.5, is essentially identical to that 
obtained by the algorithm of Ben-Tal and Nemirovski in [B-TN02] . 

Subsection 5.2, illustrates the tightening procedure of Lemma 4.3 on the matricial cube. 

5.1. Comparison with the algorithm in [B-TN02]. Let L = I + Yfi=i^(.^i ^ SM'^'''^(x) be 
a monic linear pencil and recall the pencil Cp and its corresponding positivity domain T>Cp, the 
matricial cube. In [B-TN02] the verifiable sufficient condition for the inclusion T)p{\) C T)l{1) 
is the following: Suppose there exist symmetric matrices Bi, . . . Bg such that 

(S) Bj t ±Aj for all j = 1,2, . . . , g; and I - Bj t 

j 

holds. Then Pcp(l) Q ^l(I)- 

The following proposition says that the estimate of the largest cube contained in a given 
spectrahedron given by the matricial relaxation based upon the matricial matrix cube algorithm 
is the same as that based upon condition (S). 

Proposition 5.1. Given p G M>o, condition (S) holds if and only if T>Cp ^ T>l. Moreover, 
there is an explicit formula for converting condition (S) to a feasible point for the matricial 
matrix cube algorithm and vice-versa. 

Proof. Suppose we have found the optimal p and the corresponding for j = 1, . . . ,2g, in 
the matricial matrix cube algorithm. From (preMC2) pAj = — C^'^K Set 

pB^ := a +C3+K 

From (preMCi), 

(5.1) p{B^ - Aj) = 2C^ t and p{B^ + Aj) = 2C^+'^ h 0. 

Relation (preMCs) gives / = pJ2j ■ Thus we see B^ and p satisfy (S). 

Conversely, suppose Bj,p are a solution to (S). Solve (5.1) for ,C^~^K It is straightfor- 
ward to check that these satisfy the conditions (preMCj) for j = 1, 2, 3. ■ 
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Now that we know the estimate provided by our relaxation is the same as that of algorithm 
(S), we look at the computational cost. (S) has ^gd{d+ 1) unknowns and the number of d x d 
matrix inequality constraints is {2g + 1). As we saw, our matricial matrix cube algorithm had 
^{g — l)d{d + 1) unknowns and 2g matrix (d x d) inequality constraints, so the costs are a 
bit less than those of (S). However, (S) can be improved easily by the general trick in the 
following remark which removes an unknown and a constraint, thus making the cost of (S) the 
same as ours. 

Remark 5.2. If, in the Ai^g in the inclusion algorithm of Section 4.1 all have trace 0, then the 
condition — YlpLi <^pp = is equivalent to the inequality A = I^j — YlpLi Cpp ^ 0, since then 
the Cpp can, without harm, be replaced by Cpp + When presented with the inequality form 
we could convert it to equality, then eliminate one variable by solving for it. 

5.2. The lattice of inclusion algorithm relaxations for the matrix cube. A virtue 
of the general method of the inclusion algorithm based on matricial relaxations is that, as 
alluded to in Section 4.3, it allows tightening in order to improve estimates (with added cost). 
This subsection discusses and illustrates properties of this tightening procedure, mainly as 
an introduction to a topic that might merit further study. We do show in an example that 
tightening can produce an improved estimate. 

5.2.1. General theory. The operator theory upon which this paper is based, when converted 
to the language of LMIs, contains a theory of matricial relaxations of a given LMI set and thus 
provides a general framework containing the tightening methods described in Section 4.3. 

Suppose S" C is an LMI set; i.e., suppose there is a monic linear pencil A such that 
S = Pa(1). The collection £5 of all monic linear pencils L with S = is naturally 

ordered by inclusion. Namely, if L, M G Cs, then L > M if, T>L{n) C ^^/(n) for every positive 
integer n. If A' is also a monic linear pencil and S Q S' = T>/<^i, then the matricial inclusion 
T^M ^ T^A' implies the inclusion T>l C T>\'. Thus, the pencil L gives at least as good a test for 
the inclusion S Q S' , than does M. Similarly, if M',L' e Cs' and L' > M', then M' gives at 
least as good a test for the inclusion of S into S' as does L' . 

If Cs has a maximal element, denote it by Lmax and similarly for Lmin. Generally, Cs 
will not have either a minimal or maximal element; however, it turns out for the matrix 
cube there is a minimal element. See Proposition 5.3 below. Further, in general by dropping 
the requirement that the pencils L have matrix coefficients and instead allowing for operator 
coefficients, it is possible to prove that Lmax and -Lmin exists. (The discussion in [Pau02] on 
max and min operator space structures is easily seen to carry over to the present setting.) 

Thus, though typically not practical, the matricial relaxation for the inclusion of the set 
S = 'Ca(I) into T = V\i based upon using Lmax in place of A produces the exact answer; 
whereas the matricial relaxation based upon "CL^^ij^ produces the most conservative estimate 
over all possible matricial relaxations. 
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5.2.2. Lmin and Lmax for the matrix cube. From the next proposition it follows that for the 
matrix cube Pc^(l) the minimal pencil Lmin is Ci. 

Proposition 5.3. If M is a monic linear pencil and C 'Dcp{l), then Dm ^ '^Cp- In 

particular, if T)m{^) = '^Cp(l); Oind L is a monic linear pencil for which Dcp ^ I^L, then 
T^M ^ T^L- Hence ifT>M{l) = 'Dc^(l), then the inclusion C T>l is at least as good a test 
for Dl to contain the unit cube as the inclusion T>Ci ^ I^L ■ 

Proof. Write M = 1 -J2^jXj- The condition Pj\f(l) C Pcp(l) implies, if 

— ^j^j ^ I J for some xj G M, 

then \xj\ < 1 for each 1 < j < (7. 

Now suppose that X = (Xi, . . . , Xg) £ (SM"^")^ and 

^Y.A,(^X,^pI. 

For each vector / and unit vector x (of the appropriate sizes), it follows that 

-^Y^{AjfJ){X,x,x)<\\ff. 

With X fixed, varying / shows that 

-'^Aj{XjX,x) ^ /. 

It now follows that \{XjX,x)\ < 1 for each j and unit vector x. Hence, \\Xj\\ < 1 for each j 
and hence X G T)Cp{n) and the proof is complete. ■ 

We have not computed -Lmax for the matrix cube (g > 2 variables), but we have for the 
matrix square {g = 2 variables) and found it to be a pencil with operator (infinite dimensional) 
coefficients. We do not give the calculation in this paper, rather we content ourselves with 
the simple, and natural, example below which suffices to show that there are in fact choices of 
M in Proposition 5.3 which do lead to improved estimates for the matrix cube problem and 
that -Ljiiin and Lmax are different for the cube. Of course, any such improved estimate comes 
with additional computational cost; and, because it is in only two variables (where solving four 
LMIs gives the exact answer), the example is purely illustrative. 

Given r] = (s, t) G with s^ + 1"^ = 1, let 



s 
-s 



t 
t 



Recall, a unitary matrix which is symmetric is called a signature matrix. Up to scaling the 
Aj{r]) are signature matrices, and further (^1(77) it ^2(7?))^ = /. 

It is straightforward to show that 'Dl^(I) contains the unit square; i.e., 2?c^(l) C 25^^(1). 
Hence, with = Ci ® L^, 



30 



HELTON, KLEP, AND MCCULLOUGH 



and at the same time, 

(5.2) Vm.QVc,. 

On the other hand, for -q 7^ (±1,0) or (0, ±1), it is possible to check by hand that Vc-^{n) % 
T>L^{n) for each n > 2. Indeed, let X = {Xi,X2) denote the tuple of 2 x 2 matrices 

1 

1 

Then {Xi,X2) € 'Dci(2), but {Xi,X2) ^ Vi^{2). Hence, the inclusion in equation (5.2) is 
proper. 

Another way to see the inclusion is proper is to verify that the extreme points X = [Xi , X2) 
of T>c^{n) are exactly the pairs of n x n signature matrices Xi,X2. On the other hand, for 
rj {(±1,0), (0,±1)}, the extreme points X = {Xi,X2) of Vc^{n) which are also in VL^{n) 
are precisely the pairs of n x n signature matrices Xi, X2 which commute. 

Example 5.4 (Example 4.4 revisited). Recall the pencil F from Example 3.1. In Example 4.4 
we employed the matricial matrix cube relaxation C Pp to obtain a lower bound of ^ for 
the biggest square inside ^?r(l)- To tighten the relaxation we direct sum to Cp to obtain a 
linear pencil M^. Hand calculations for this problem tell us that with rj = (-v/2/2, \/2/2) we 
obtain the exact relaxation ^ Pp. However, suppose we did not know this and ask: will 
selecting r] without much care give a reasonable improvement? 

We made 100 runs with random r/ and considered the inclusion /cPm^ C Pp for each r/ 
and found the average value for p to be approximately 0.6. This is a considerable improvement 
over 0.5 obtained in the untightened problem. □ 

6. POSITIVSTELLENSATZE ON A MATRICIAL LMI SET 

We give an algebraic characterization of symmetric polynomials p in noncommuting vari- 
ables with the property that p{X) is positive definite for all X in a bounded matricial LMI 
set Vl. The conclusion of this Positivstellensatz is stronger than previous ones because of the 
stronger hypothesis that is an LMI set. If the polynomial p is linear, then an algebraic 
characterization is given by Theorem 1.1. We shall use the linear Positivstellensatz, Corollary 
3.7, to prove that the quadratic module associated to a monic linear pencil L with bounded 
Vl is archimedean. Thereby we obtain a Putinar-type Positivstellensatz [Put93] without the 
unpleasant added "bounding term". In this section, for simplicity of presentation we stick to 
polynomials on the free *-algebra. Later in Section 7 we give this improved type of Positivstel- 
lensatz on general *-algebras, a few examples being commuting variables, free variables and free 
symmetric variables (this section). The material here is motivated by the study of positivity 
of matrix polynomials in commuting variables undertaken in [KSIO]; see also [HM04]. 

To state and prove our next string of results, we need to introduce notation pertaining to 
words and polynomials in noncommuting variables. 



1 
-1 



and X2 
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6.1. Words and NC polynomials. Given positive integers n, d,d' and g, let M'^''^'^ denote 
the d' X d matrices with real entries and (R"^"')^ the set of (/-tuples of real n x n matrices. 

We write {x) for the monoid freely generated by x = {xi, . . . ,Xg), i.e., {x) consists of 
words in the g noncommuting letters xi, . . . ,Xg (including the empty word which plays the 
role of the identity 1). Let M{x) denote the associative M-algebra freely generated by x, i.e., 
the elements of M{x) are polynomials in the noncommuting variables x with coefficients in M. 
Its elements are called (NC) polynomials. An element of the form aw where 7^ a S R 
and w G (x) is called a monomial and a its coefficient. Hence words are monomials whose 
coefficient is 1. Endow with the natural involution fixing M U {x} pointwise. The 

involution reverses words. For example, (3 — 2x^x2X3)* = 3 — 2x2,X2x\. 



6.1.1. NC matrix polynomials. More generally, for an abelian group R we use R{x) to denote 
the abelian group of all (finite) sums of monomials in (x). Besides i? = M, the most important 
example is R = W^'^'^ giving rise to NC matrix polynomials. If d' = d, i.e., R = M.'^^^, then R{x) 
is an algebra, and admits an involution fixing {x} pointwise and being the usual transposition 
on M'^^'^. We also use * to denote the canonical mapping R'^'^'^{x) — ^ ]R'^^'^'(x). 

A matrix NC polynomial is an NC polynomial with matrix coefficients, i.e., an element 
of E'^'^'^(x) for some d',d£N. 



6.1.2. Polynomial evaluations. If p £ M^''^'^{x) is an NC polynomial and X £ (M"^")^, the 
evaluation p{X) G '^d'nxdn jg defined by simply replacing Xj by X^. For example, if p(x) = 
AxiX2, where 



A 



then 



P 



1 

1 



Ai 




3 



4 


-3 





2 





A(S)I„,. 



fnxn\9 . 



our mvo- 



Similarly if p{x) = A and X € (M"><")^, then p{X) 

Most of our evaluations will be on tuples of symmetric matrices X G (SI 
lution fixes the variables x element-wise, so only these evaluations give rise to *-representations 
of NC polynomials. 



6.2. Archimedean quadratic modules and a Positivstellensatz. In this subsection we 
use the linear Positivstellensatz (Corollary 3.7) to prove that linear pencils with bounded 
LMI sets give rise to archimedean quadratic modules. This is then used to prove a (nonlinear) 
Positivstellensatz for matrix NC polynomials positive (semi) definite on bounded matricial LMI 
sets. 
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Theorem 6.1. Suppose L £ §iW^^'^{x) is a monic linear pencil and is hounded. Then 
for every symmetric polynomial f G M.^^^{x) with >- 0, there are Aj G M^^^(x), and 

Bk G M'^^^(x) satisfying 

(6.1) f = Y,A*A,+J2BlLBk. 

3 k 

Corollary 6.2. Keep the assumptions of Theorem 6.1. Then for a symmetric polynomial 
f G M^^^(x) the following are equivalent: 

(i) f\v, >z 0; 

(ii) for every e > there are Aj G M.^^^{x), and Bk G M.'^^^{x) satisfying 

(6.2) / + ^ = E ^1^^- + E ^kLBk. 

j k 

Proof. Obviously, (ii) =^ (i). Conversely, if (i) holds, then / + eji?^ >~ and we can apply 
Theorem 6.1. ■ 

We emphasize that convexity of T>l implies concrete bounds on the size of the matrices 
X G Vl that need to be plugged into / to check whether /Id^ >- 0: 

Proposition 6.3 (cf. [HM04, Proposition 2.3]). Let L G ER'^'^'^ix) be a linear pencil with Vl 
bounded, and let f = f* £ ]R"^"(j;) be of degree m. Set s := n^^^^^gK Then: 

(1) f\vL >-0 if and only if flv^is) >- 0; 

(2) f\vL '^0 if and only if flv^is) h 0. 

Proof. In both statements the direction (=^) is obvious. If flv^ ^ there is an i, X £ T>L{i) 

{f{X)v,v)<0. 



and V = ®]=iVj G (R^r with 



Let 

/C := {w{X)vj \ w £ {x) is of degree < m, j = 1, . . . , n}. 
Clearly, dim/C < n^^^^^g^ = s. Let P be the orthogonal projection of onto /C. Then 

{f{PXP)v,v) = {f{X)v,v) <Q. 

Since PXP £ T>l{s), this proves (1). The proof of (2) is the same. ■ 

The crucial step in proving Theorem 6.1 is observing that the quadratic module generated 
by L in M.^^^{x) is archimedean. This is essentially a consequence of Corollary 3.7, i.e., of the 
linear Positivstellensatz as we now demonstrate. 

Definition 6.4. Let ^ be a ring with involution a i— t- a* and set Sym^ := {a £ A \ a = a*}. 
A subset M C Sym^ is called a quadratic module in A if 

1 G M, M + M C M and a*Ma C M for all a £ A. 
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We will be mostly interested in the case A = M.^^^{x). In this case given a subset 5 C 
SymR'^^'^(x), the quadratic module Mg generated by S in M.^^^{x) is the smallest subset of 
SymR^^^(x) containing all a*sa for s G 5U {!}, a G M'^^^(x), and closed under addition: 

N 

M| = |^a*Siai I iVGN, Si G SU{1}, at GM^^^(a;)}. 

i=l 

This notion extends naturally to quadratic modules generated by 5 C U^gj^ SymR"'^'^(a;). 
Definition 6.5. A quadratic module M of a ring with involution A is archimedean if 
(6.3) Va G ^ 3iV G N : N -a*aeM. 

To a quadratic module M C Sym A we associate its ring of bounded elements 

Hm{A) := {o G ^ I G N : N -a*aeM]. 
A quadratic module M C Sym^ is thus archimedean if and only if Hm{A) = A. 

The name ring of bounded elements is justified by the following proposition: 

Proposition 6.6 (Vidav [Vid59]). Let A he an M.-algebra with involution, and M C Sym^ a 
quadratic module. Then Hm{A) is a subalgebra of A and is closed under the involution. 

Hence it suffices to check the archimedean condition (6.3) on a set of algebra generators. 

Lemma 6.7. A quadratic module M C M^^^(x) is archimedean if and only if there exists 
N en with N - x*x = N - Y^i xj G M. 

Proof. The "only if" direction is obvious. For the converse, observe that 'Ef^^{x) is generated 
as an M-algebra by x and the £ x £ matrix units Eij, i,j = By assumption, 

iV - xf = (TV - ^ x?) + ^ x] G M, 

SO Xj G HMm^^^{x)) for every j. On the other hand, E^^Eij = Ejj and thus 

l-E*jE,, = Y,ElkEkk&M. 

Hence by Proposition 6.6, Hm{^^^^{x)) = M^^^(x) so M is archimedean. ■ 
We are now in a position to give our crucial observation. 

Proposition 6.8. Suppose L G SM'^^'^(x) is a monic linear pencil and Vl is bounded. Then 
the quadratic module M^j^^ generated by L in M.^^^{x) is archimedean. 

To make the proof more streamlined we separate one easy argument into a lemma: 
Lemma 6.9. For S C U^gj^ SymM"'^'^(a;) the following are equivalent: 
(i) Mg is archimedean for some £ G N; 
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(ii) Mg is archimedean for all ^ E N. 



Proof, (ii) =^ (i) is obvious. For the converse assume (i) and let p G N be arbitrary. By 



assumption, there is S N with (A^ 
then 



x*x)h G M|. If 



{Eff^YiN - x*x)IiE['f> G MP. 



denote the ,s x q matrix units, 



Now using permutation matrices we see (A^" — x*x)E^^-'P^ S for all j concluding the proof 
by the additivity of MS. 



Proof of Proposition 6.8. Since is bounded, there is A^ G N with A^ > ||X|| for all X G V^. 
Consider the {g +1) x {g + 1) monic linear pencil 



/ , 1 
Jn[.x) = — 



N 
x 



NI„ 



By taking Schur complements, we see Jn{X) ^ if and only if A^ - ^ > 0, i.e., if and 

only if \\X\\ < N. This means JnIv^ ^ and so by Corollary 3.7 (in the new terminology), 
J'n G ^fL}- Since M^^^ is closed under *-conjugation, we obtain 



A^ 




{N 



jyX X^Ig 



■ TV' 



NJNix) 



' n'- 



Again, using permutation matrices leads to {N'^g — x*x)Ig^i G M'^^^ . By Proposition 6.6, 



^{L} archimedean. Finally, Lemma 6.9 implies is archimedean. ■ 

Corollary 6.10. For a monic linear pencil L the following are equivalent: 

(i) I'_l(1) is bounded; 

(ii) the quadratic module M^^^ is archimedean for some I G N; 

(iii) the quadratic module M^^^ is archimedean for all ^ G N. 

Proof. Clearly, (iii) =^ (ii) (i). On the other hand, (i) is equivalent to T>l being bounded 
by Proposition 2.4, so Proposition 6.8 applies and allows us to deduce (iii). ■ 

Proof of Theorem 6.1; compare [HM04, Proposition 4.1]. The statement (6.1) holds if and only 
if / G Mfry. Now that the archimedeanity of the quadratic module Affy-i has been established 



{L} 



in Proposition 6.8, the proof is classical. We only list basic steps and refer the reader to [HM04] 
for detailed proofs. 

The proof is by contradiction, so assume / ^{l}' Archimedeanity of Af|^| is equivalent 
to the existence of an order unit (also called algebraic interior point), namely 1, of the convex 
cone M 



map ip : 



{L} ^ Sym] 



^^^{x). Thus the Eidelheit-Kakutani separation theorem yields a linear 
^ satisfying 

(^(/)<0 and ^(M(^|)CM>o. 
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Modding out TV := {/ G IR^^^(x) | ip{p*p) = 0} out of M^^^(x) leads to a vector space Ho 
and (f induces a scalar product 

Completing T-Lq with respect to this scalar product yields a Hilbert space 7i. It is nonzero 
since Ylii^i^^i) — V'(l) = 1) where are the matrix units of M^^^. Let e = ©e^ S H^. 

The induced left regular *-representation vr : — )• B{T-L) is bounded (since ^{i} is 
archimedean). Let := 7r(Xj) and X := {Xi, . . . ,Xg). The constructed scalar product 
extends naturally to 'H.'^. For every p G ?^q, we have 

{L{X)p,p) = J2{H^)j,kPj,Pk) = '^'f{plL{x)j^kPj) = v{p*L{x)p) > 0, 

j,k j,k 

where p has been identified with a £x i matrix polynomial and the last inequality results from 
p*L{x)p G Hence X G V^. But now 

0>V5(/) = (/(X)e,e) >0, 
a contradiction. ■ 

The cautious reader will have noticed that the constructed X leading to the contradiction 
was (in general) not acting on a finite dimensional Hilbert space. However this is only a slight 
technical difficulty; we refer the reader to Proposition 6.3 or [HM04, Proposition 2.3] for a 
remedy. 



6.3. More constraints. Additional constraints can be imposed on elements of a matricial 
LMI set. Given S C U^gN SymM'^^'^(x), define 

Vs{n) = {X G (S]R"^")3 I Vs G 5 : s{X) t 0}, 

and let 

neN 

denote the (matrix) positivity domain. Also of interest is the operator positivity domain 

= {X G SymB{nf I Vs G 5 : s{X) t O}. 

Here Ti is a separable Hilbert space, and SymBlT-l) is the set of all bounded symmetric oper- 
ators on Ti. 

Theorem 6.11. Suppose L G SW^'^'^ix) is a monic linear pencil and T>l is bounded. Let 
Qj G SymM'^J ^"^J (x) {j G N) he symmetric matrix polynomials. Then for every f G SymM^^^(x) 

Proof. Since the quadratic module 3 |jgN} — ^{L} ^® archimedean, the same proof as for 
Theorem 6.1 applies. ■ 
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Remark 6.12. For a particularly appealing consequence (in commuting variables) of Theorem 
6.11 see Section 7.1. 

We conclude this section with a Nichtnegativstellensatz. It is a stronger form of the 
Nirgendsnegativsemidefinitheitsstellensatz [KS07] for matricial LMI sets. 

Corollary 6.13. Let L G SR'^'"^{x) be a monic linear pencil and suppose T>l is hounded. Let 

Qj G SymlR'^J^'^J (x) (j G N) he symmetric matrix polynomials. Then for every h G SymM^^^(2;) 
the following are equivalent: 

(i) h\x>'^^ | 2^ 0, i.e., for every {nontrivial separahle) Hilhert space % and tuple of sym- 
metric hounded operators X G 2?!^ g |jgN} '^'^ ^^^'"'^ is a v £ Ti with {h{X)v,v) > 0; 

(ii) there are Dj G M^^^(x) satisfying 

(6-4) Y.^j^^^'^^^ + ^ka.bm- 

Proof, (ii) =^ (i) is obvious. The converse is also easy. Just apply Theorem 6.11 with / = — 1 
and the positivity domain 'D'^ _^ g \j&'N} ~ ^- * 

Remark 6.14. There does not seem to exist a clean linear Nichtnegativstellensatz. We found 
4x4 monic linear pencils Li, L2 in nine variables with the following properties: 

(1) and Vl^ bounded; 

(2) L2\vl-^ 7^ 0) or equivalently, 

J X G M' 



LiiX) 
-L2{X) 



(3) there do not exist real matrices Uj, Vk, Wi with 

(6.5) Y.^*L2{x)U, = I + Y,W;We + Y.^,*L^ix)Vk. 

j Ik 

By Corollary (6.13), (1) and (2) imply that (6.5) holds with Uj,Vk,Wi G M'*^^(x). A Mathe- 
matica notebook with all the calculations is available at http : //srag. fmf .uni-lj .si. 



7. More general Positivstellensatze 

In this section we present two possible modifications of our theory. First, we apply our 
techniques to commuting variables and derive a "clean" classical Putinar Positivstellensatz on 
a bounded spectrahedron. This is done by adding symmetrized commutation relations to our 
list of constraints. In fact we can add any symmetric relation and get a clean Positivstellensatz 
on a subset of a bounded LMI set (this is Theorem 7.4). In Section 7.2 we also show how to 
deduce similar results for nonsymmetric noncommuting variables. 
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7.1. Positivstellensatze on an LMI set in M^. We adapt some of our previous definitions 
to commuting variables. Let [y] be the monoid freely generated by y = (yi, . . . ,yg), i.e., [y] 
consists of words in the g commuting letters yi, . . . ,yg (including the empty word which 
plays the role of the identity 1). Let M[y] denote the commutative R-algebra freely generated 
by y, i.e., the elements of R[y] are polynomials in the commuting variables y with coefficients 
in M. 

More generally, for an abelian group R we use R[y] to denote the abelian group of all R- 
linear combinations of words in [y]. Besides R = M, the most important example is R = M'^'^'^ 
giving rise to matrix polynomials. If d' = d, i.e., R = W^^'^, then R[y] is an M-algebra, and 
admits an involution fixing {y} pointwise and being the usual transposition on M'^^'^. We also 
use * to denote the canonical mapping is a polynomial 

and y € M^, the evaluation p{Y) G M.^''^'^ is defined by simply replacing y^ by 1^. 

The natural map (x) — )• [y] is called the commutative collapse. It extends naturally to 
matrix polynomials. 

For Aq, Ai, . . . , Ag G SM'^^'^, a linear matrix polynomial 

(7.1) m = Ao + j2A,yj G SM-^^-^b], 

i=i 

is a linear pencil. If Aq = I, then L is monic. If Aq = 0, then L is a truly linear pencil. Its 
spectrahedron is 

Vl{1) = {F GM^ I L{Y) h 0}, 
and for every G N, L induces a quadratic module Q^^x^j in 

TV TV 

Q{L} = { E + E I e N, a. G R'^^'iy], b, G M'^^^Iy]}. 
i=i j=i 

All the results on linear pencils and archimedeanity given in Section 6 carry over to the 
commutative setting. For instance, given a monic linear pencil L G SM'^^'^[y], we have: 

(1) Qj^i is archimedean for some £ G N if and only if Q^^^y is archimedean for all £ G N; 

(2) Qj^i is archimedean if and only if the spectrahedron I'l(I) is bounded. 

Most importantly, we obtain the following clean version of Putinar's Positivstellensatz 
[Put93] on a bounded spectrahedron. 

Theorem 7.1. Suppose L G SM'^^'^fy] is a monic linear pencil and T)l[1) is hounded. Then 
for every symmetric polynomial f G with /|x)£(i) >- 0, there are Aj G R^^^[y], and 

G M'^^^[y] satisfying 



(7.2) 



f = Y,A]A,+Y,BlLB,. 

j k 
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Proof. Let F E SymM^^^(x) be an arbitrary symmetric matrix polynomial in noncommuting 
variables whose commutative collapse is /. By abuse of notation, let L S §M.'^^'^{x) be the 
canonical hft of L G SM'^^'^[y]. Write 

for i,j = 1, . . . ,g. Note gij{X) ^ if and only if XiXj = XjXi. By the spectral theorem, 
Fl-nrr I , 1 ^ 0. So Theorem 6.11 implies and yields 

^e^{L,3,,.|ij=l,...,g}- 

Applying the commutative collapse gives / E Qf^j, as desired. ■ 

Corollary 7.2. Suppose L e SR"'^'^[y] is a monic linear pencil and "is bounded. Let 

gi,...,gs ^ and 

VL{gi, ...,gs):={Y eW\ L{Y) h 0, gi{Y) > 0, . . .,g,{Y) > 0}. 
If f ^ satisfies f\vi^{gi,...,gs) > 0, then there are hij G and Bk G satisfying 

s 

(7.3) f = Y,9,Y.^% + Y.BlLBj,, 

j=0 i k 

where go := 1. 

Corollary 7.3. Suppose L G is a monic linear pencil andT>L{l) is bounded. Then for 

every polynomial f G ]R[y] with f\-z)^{i) > 0, there are hj G and Bk G ]R''^^[y] satisfying 

(7.4) f = Y,h] + J2B*kLBk. 

j k 

It is clear that a Nichtnegativstellensatz along the lines of Corollary 6.13 holds in this 
setting. We leave the details to the reader. 

7.2. Free (nonsymmetric) variables. In this section we explain how our theory adapts to 
the free *-algebra. Let (x,x*) be the monoid freely generated by x = (xi, . . . ,Xg) and x* = 
(xj, . . . , X*), i.e., (x, X*) consists of words in the 2g noncommuting letters xi, . . . , Xg, xj, . . . , x* 
(including the empty word which plays the role of the identity 1). Let C(x,x*) denote 
the C-algebra freely generated by x,x*, i.e., the elements of C(x,x*) are polynomials in the 
noncommuting variables x,x* with coefficients in C. As before, we introduce matrix poly- 
nomials C'^'^'^(x,x*). If p G C'^'^'^{x,x*) is a polynomial and X G (C"^")^, the evaluation 
p{X,X*) G C"''^'^ is defined by simply replacing Xj by Xi and xT by X^. 

For Ai, . . . , Ag ^ C'^^'^ , a linear matrix polynomial 

9 

(7.5) L(x) = ^j^j e C'^^'^(x), 



THE MATRICIAL RELAXATION OF AN LMI 



39 



is a truly linear pencil. (Note: none of the variables x* appears in such an L.) Its monic 
symmetric pencil is 

9 9 

£{x,x*) = I + L{x) + L{x)* = / + ^^jXj + G Sym&'"^{x,x*). 

j=i j=i 

The associated matricial LMI set is 

Vc=\J{x e (c"^")5 1 C{x) y 0}, 

its operator-theoretic counterpart is 

v^ = {x £ B{ny I c{x) t o}, 

and for every ^ G N, £ induces a quadratic module M^^y in C^^^{x,x*): 



N N 

M" 

i=l j=l 



iv iv 

'{C} = {^^'^i + \NeN,aie C^''^{x,x*), bj G C^^^(x,x*)}. 



Like in the previous subsection, all our main results from Section 6 carry over to this free 
setting. As a sample, we give a Positivstellensatz: 

Theorem 7.4. Suppose C G SymC'^^'^(x, x*) is a monic symmetric linear pencil and T>c is 
bounded. Let gj G SymC'^-'^'^-'(x,x*) (j G N) be symmetric matrix polynomials. Then for every 
f G SymC^^^(x,x*) with f\vf^^^^^^^^^ >- 0, we have f G Mf^^^^^.^^y 

As a special case we obtain a Positivstellensatz describing polynomials positive definite 
on commuting tuples X in a matricial LMI set. (Note: we are not assuming the entries Xi 
commute with the adjoints X*.) 

Corollary 7.5. Suppose C G SymC'^^"'(x, x*) is a monic symmetric linear pencil and Vc is 
bounded. Suppose f G SymC^^^(x, x*) satisfies f{X,X*) y for all X e with XiXj = 
XjXi for all i,j. 

(1) Let Cjk = XjXk — XkXj. Then 

f G 

J ^ {C,Cjk+c*^,i{cjk-Ckj)\j,k=l,...,g}- 

(2) Let djk = -c*i^Cjk. Then 

f ^ ^{£,d,.fc|i,fc=l,...,g}- 
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